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Adolfo Guzman's SEE program groups the regions of a two-dimensional 
scene into bodies, using local evidence in the scene to link regions 
Together. This paper discusses an extended version of the SEE pro¬ 
cedure that makes extensive use of evidence in the scene Which indi-' 
cates that two regions should be split into separate bodies* 

The new procedure is better in several waysi 1) it correctly 
analyzes many scenes for which SEE makes mistakes; 2) it can inter** 
act with a higher-level object-recognizing program; 3) it can provide 
alternative solutions on demand. 
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1 Introduceloft 

1.1 Corn-put er vt S1 o ft 

Fot the last several years, the Artificial Intelligence Croup of 
M. l.T. t e Project- MAC has bean seeking to develop mote complex and 
powerful ways for computers to interact with their environment. On* 
of the products Q f thii research is a primitive scene-perceiving 
system, which is represented schematically in the flow diagram of 
figure 1-1. 

1.L.1 Pre-processing 

The system begins with an actual scene, from which all informa¬ 
tion ultimately derives. The eyt of the System i* a television 
camera Specifically designed to interact with a Computer* A program 
developed by Griffith [Ij processes the output of th* camera to 
produce a line drawing of the scent. This line drawing, appropriate¬ 
ly corrected and encoded] ie used as the representation of the scene 
itself by all higher-level programs in the system. 

1.1.2 Processing of the line drawing 

Much of tha following description of the MAC vision system is 
taken from Patrick B- Winston*s Ph.D* thesis {21+ 

1 . 1 . 2*1 Classification of vertices 

A program written by H. H* Mahabala [3] classifies and libels the 
vertices in the scene according to the number of converging Line* at 
each vertex and the angles between theja. Figure 1-2 displays the 
vertex typos which are recognized* Sctice that pairs of Ts with 
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Figure 1-1 
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Figure 1-2 







CfoSstars lying between collinear upright* 5re found by Mshafco 1 a f s 
program, These arc called matching-Ts. 

The pjfogi'api then proceeds to create cusie* for all of the n^inne 
in the scene, Rigorously* ''region" as used here simply refers to any 
mnxLmnil area in which one can (save from any point to any other point 
without crossing a line. For example t figure 1*5 has eight regions d 
Pot Counting the background. 'Various properties Are calculated and 
stored for these regions. Among these Are a list of the vertices and 
bordering region* which Surround each region, 

1.1,2.2 The SEE procedure 

These results are then supplied to the program named SEE devel¬ 
oped by A. Cufcmen I4l* This program conjectures about which regions 
belong to the same objects* For figure 1-3, the and result of the 
program is the commentary; 

Body 1 cons1sta of A E C 

Body 2 consists of D E F G H 

Surprisingly the program centsins no explicit modeis for the objects 
it expects to see* It Simply essraines the vertices and uses the 
vertex classifications to determine which of the neighboring regions 
are likely to be part of the same object, ARROWs* for example, 
Strongly suggest that the two narrow-angle regions belong to the same 
body {figure 1-4), This evidence la represented by SEE ss a strong 
link placed between the regions which are suspected of belonging to 
the same body* Figure 1-5 depicts * link which has been placed 
between regions 1 and 2 as a result of the evidence provided by the 
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AEBDV a. 

Since links site often generated between Tegipns belonging to 
different bodies, SEE is not satisfied with the evidence represented 
by e single link; two or snore links Ere required to bind two tSgiona 
together into a 3 ingle nucleus . A nucleus represents a set of regions 
which will eventually be reported as belonging to a single object in 
the scene. Two or more links between a pair of nuclei will Similarly 
result in their conglomeration into a Still larger nucleus. The 
nuclei grow in this fashion until no two of them, can be combined by a 
double link; they arc then called maxi cm 1 nuclei . SEE then uses 
weaker evidence in the form of weak links to further merge some 
nuclei. Finally, special heuristics are employed to attempt to 
eliminate nueLei consisting of a single region by combining them with 
Other nuclei. 

This fairly sophisticated procedure qan sort out the regions in 
scenes as complicated as that In figure h6 t borrowed from Guzman's 
thesis. Twelve objects are reported and the regions of each arc 
remembered. 

1+1.2.3 Higher-level analysis 

HinSton ha* developed and implemented procedures which use the 
output of SEE to create network-structured descriptions of scenes. 
These descriptions are used by Winston's programs for comparisons, 
concept learning, and identification. 

1,2 Possible improvements to SEE 

Refer agaio to the flow diagram of figure 1-1, VtaiStoh ha* 
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npted chat all Info irrigation in the system moves In one ■direction only, 
as indicated by ail of the arrows In the diagram pointing, from, bottoivi 
to top. Ha remarks: M There is as yet no way a process can discourse 
With and modify the behavior of any process acting below Ic." [2) 

One of the aims of this research is Co enable SEE to receive such 
dtscourse from above. 

Another possible 1mprovement to SEE is indicated by the scene of 
figure 1-7 + Vertices a* b> and £ each generates one strong; and one 
week Link* causing SEE to report a single body composed of regions 1, 
2, 3j and 4. A mart satisfactory analysis would find two abutting 
wed ges. 

In figure 1-8* which is ambiguous, SEE again finds one body. 
Either of the two Alternative analyses depicted Would be better. 

1.3 SEEMQREj An extension of SEE 
1*3.1 Basic properties *f 8EEMQRE 

In view of the problems of SEE noted above* it Would be useful 
for a modified SEE procedure to fulfilL the following requirements; 

1) It should correctly handle all cases which SEE handles 
correctly. 

2) It should correctly handle many cAses, such as figure 1-7 t 
Which SEE handles incorrectly. 

3) It Ehould provide for interaction with a higher-level 
object-recognising program such as Winston’a. 

4) In cage its first Analysis is unsatisfactory) or in cast of 
ambiguous scenes Such As figure 1-3, it should be capable of 
generating plausible Alternative answers, 

1 have devised a procedure called EREM&KE which aeeas to satisfy 


all of the Above criteria for many scenes, 5EEM0KE has not been 
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Figur* 1*8 


















programmed? but hi-* teen developed extanstvtly through hand- & imulaC1cns 
Oft a largo number of acenes. For the scene of figure 1-6, for example, 
8-EEHQRE produces the seme answer ds SEE, finding twelve bodies. In 
figure 1-7, SEEMOhE finds the wedges (1 3) and (2 4), For the 
ambiguous scene of figure 1-B, 5EFM&RE produces both of the altetr^ 
natives depicted. 

SEEMOBE can also handle the difficult Scene depicted in figure 
In this case* four bodies are reported. These art composed of 
t eg Lons (2 3 4), (5 6), <6 9 W} 3 and <1 7 11), 

1+3,7 Splitting 

Besides forming links in the manner of Guzman** program, $EJ\M0RK 
also forms Splits , While a link represents evidence that two regions 
Ate part of the ime body, a split represents evidence that two 
regions belong to distinct bodies in the scene, To implement the 
splitting process I have developed a variety of heuristics, similar to 
those of SEE, which utilize simple local evidence to begin Splits at 
vertices and extend them along edges of objects. These new heuristics, 
along with a codified version of BEE, ere incorporated, into a 
procedure which attempts to generate alternative answers, Startins 
with the post plausible. 

1+4 A note on nomenclature 

Figure 1-10 Illustrates sane of the abbreviations and syrabols 
which will bo used In the text and diagrams of this paper. Numbers, 

Such as 3 or 5, represent regions in the scepe. The background, 

Which is region 5 in this scene, will often cist be labelled in the 
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t training diagrams* Lower-case let,tera h auth as a, j?* and £ In the 
figure, will represent vertices In the scenes. The W. 1 vy lines scijier- 
Imposed on edges tb and ha represent splits. These Will be dPsif.cv.it ed 
in the text individually at C-b and b-aj or t equivalently! as one 
continuous split c-b-O. Strang and V*sW links nr* designated by short 
•olid and dotted lints as shown, following Gurnards usage. Conglomer¬ 
ated regions will be indicated by enclosing Hats of Such region* in 
parentheses, in this esaapl*, the bodies found are (1 2) and <3 4). 


t Th« bsaic SEEmCJ&E procedure 


The flowchart of figure 2-1 illustrates the wlruetuct- of 

EEEMOREr The procedure begins by applying wry eaut ions t y £ hp.-cv 
heuristics Which Ate believed to bo moat fflllblOj this step is 
referred to AS initial Splitting And linking, or phase l. The fieri 
Atop Ln SEEMOKE r s tnllyill of a ictnl, tilled phase 2 1 fa a more 
tentative Attempt to geaerate splits by applylng h*nfl*tiCB thought to 
be less reliable than those of phase 1. If there Is no splitting 
evidence Id the ecene* phase 3 la entered directly, and SEEMORE 
reduces to a slightly modified version of SEE. 

Finallyi phase 3 applies the rest of SEE 1 S heuristics to the 
tentatively split scene and produces SEEMdRE’a first attempted So 111* 
Cion, TMs is submitted to the higher*level program for approval. If 
the higher-level program i* dissatisfied with the first analysis, It 
Will return to SEEbCRE With An Appropriate complaint. The proceeding 
of this Complaint is discussed in the next chapter. 

At various times lit phases 1 and 2, before the analysis of tho 
scene 1* complete* 5EEHDRE may consult a higher-level program to find 
out if certain sub-part* of the scene can be recognised As urwccludod 
objects. This information ia used by &EEMORE to generate additional 
Splits and links. 

2.1 Phase generate initial splits and links 

3.1.1 Splitting-vertices 

SEC-XTEE begin* by identifying those vertices in. the scene which 
may be used to initiate or artend Splits, I refer to these, patorally 
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trough* 1( Splittl rtg-v«t fclcea . A ccunraonly occurring ■pUttlng-vectPH 
It tht generalised four-line v«Eex, represented in figure 2-2A, The 
K and X joints are special usei of four-line vertices, More general¬ 
ly* any vertex of four or pur* lines is a split ting- vertex, in. the 
example of figure 2-3 p sXSMORE mark* vertices a, £* £ P d, and j» os 
■piIt ting-vertlc*s. 

lotlce in figure 2-4A that vertices a and b would be classified 
as splitting-vertlees. However, these are false vertices* in the 
»ensu that they do rot persist under a -Sinai 1 change in viewing angle, 
as shown £n figure 2-4B. On the other hand* vertices c and d are 
Invariant under snail changes In viewing angle. SEEd&KE assumes that 
all vertices in the input scene are similarly invariant; scenes like 
figure 2-4A will* in general* not be analysed properly. 

Any split which emanates from a vert** ;v is terninsted at the 
neat vertex encountered on the split line* unless the neat vertex is 
an Li %n figure 2-5* for example, a single split Initiated at vertex 
V along the line v-a is extended through vertex a end terminate* at 
vertex b as shown. 

As illustrated in figure 2-6* a split propagates through s pair 
of matchlng-Ts if the same region R borders on the center Hue* of 
both Tt» 

2*1.2 Phase l heuristics 

Hie phase 1 heuristics are used to initiate splits and links 
based upon evidence provided by splitting-vertices and special 
configurations SS described below. These heuristics are considered 






Figure i-3 














22 




figure a-4 
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to be more reliable than thee* which will be applied later in phase 2* 
2. 1.2.1 Heuristic: Split Around (ttonglj'Mnptoraeratod objects 

In order to implement this heuristic■ SHKFICitfR first invokes mi 
initial--!inkIna routine. These Initial links are placed much more 
cautiously than the more general SEE-type links to be used later* 
Vertices at which Initial links are placed are illustrated in figure 
2-7* These links are subject to the veto of a link-inhibitor of the 
sort used in $F-E, Situations in which links will be inhibited are 
Illustrated In figure £-8. A more lenient linfc*inhlbitor* to be 
described later, will he used to complete the linking In phases 2 and 
3 * 

Any two regions joined by at least tvn initial links are said to 
he EiCobers of the came HtTongly-congloniOrated nucleus ■ A region la 
considered to be a member of such a nucleus only if it la doubly 
linked to another single region within the nucleus; single links to 
two different regions in the nucleus do not suffice. Each Strongly- 
00 nglomerated nucleus of two or more regions found in. the scene is 
submitted to a higher-level program capable of recognizing objects* 

The higher-lovei program should verify the nucleus only if it makes 
sense as a complete unoccluded object in the scene* A nucleus so 
verified Is called a strong ly-eongloirif rated object , 

The use of these objects In splitting Is illustrated in figure 
2-9. The general splitting rule is shown in figure 2-9A. Strongly* 
conglomerated object (1 t 3) Has a a putting-vertex v on fte boundary; 
splits are made which extend from vertex v to neighboring vertices 
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a and b along the boundary of object (1 2 3). For ertampLCj in figure 
2-9B* split, t-d^e is rtade along the boundary of Etrangly-eoueloTncra ted 
object (4 J &). IE should be noted that the phase 2 split-extcrating 
heuristics, to be described later, are not applied to the splits just 
described, 

2.1.2.2 Heuristic; internal-T 

Vhen a I-joint borders on background as shown in figure 2*10, a 
split is placed on the center line of the 1. 

2. 1.2.3 Heuristic; special KUX.TJ 

As shown in figure 2-11* if a vertex has four or more lines of 
which two are collinear, and of which only one falls to one tide of 
the CO 11 inear lines, thee; a aplit is placed along that I ingle line* 
m the special case of a four-line vertex, this heuristic reduces to 
the X-Joint heuristic illustrated in figure 2-12, In this case, if 
either o£ the links shown in figure 2-12 Has been inhibited during the 
initial linking step, then the splits are inhibited as yell. 

2.1.2.4 Heuristic-; Split to external concavities 

This heuristic Is best explained by an example. In figure 2-13, 
the FORX vertex a borders on background] the line which daes not 
border the background, connects ta splitting-vertex In this case, a 
Split is made along v-a. Vertex a is referred to as an external 
concavity, 

More generally h this heuristic places splits from Splitting- 
vertex v to external, concavity a in either of the situations depicted 
in figure 2-14. 








Figure Z-II 
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X.C is conjectured that it would also be useful to split between 
FOUXs and external concavities; In other words, to allow the vertex v 
in figure 2-14 to be 3 IE>BK. This additional heuristic would place the 
important split a-b in figure 2-15* enabling bpdy {[ ?.} to be 
separated from region 3. However 5 this heuristic is not included in 
the current version of SKEMQRE pending further study. 

2,1.2.5 Heuristic; split the crossbar of the T-ARROW 

Hie configuration for which this heuristic applies is illustrated 
in figure 2-16, Splits propagate along the crossbar of the T in both 
directions. In figure 2-17, this heuristic generates the split a-b-c. 

A variation of this heuristic which is employed in phase L is the T-X 
configuration depicted in figure 2-18, Under Study but not being used 
is the T-link configuration shown in figure 2-lf>. 

2*2 Phase 2; Generate other plausible splits 
2.2.1 Extending splits 

This routine uses evidence provided by splitting-vertices and 
other configurations tD extend Splits which have been placed in phase 
1+ Xhe routine applies only a couple of heuristics- at present, and 
ipay represent an area in which new heuristics and some fine tuning 
Would help significantly the performance of the SEEHDEE procedure 
on difficult scenes. 

A very cannon situation for extending a split is represented in 
figure 2-20, If exactly one split terminates at A four-line vertex 
such As split a-b in the figure, then the split extended along the 
Opposite line b-o. In addition! Links Aft placed across the two 
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Figure 2-16 
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unsplit line# as shown, Figure 2-21A represents a scene in which in¬ 
itial splitting and linking has been comp Let ed, and the sp]it- 
extending heuristic applies. The result i* shown In figure 2-2IE, 
Koticc that the link at vortex e has been broken by the Split frorr. b 
to e. The split- extending would be finished at this point, since no 
other Splitting-vertices rftn&in. 

This split-extending heuristic applies to Ks and Xs as special 
eases of four-line vertices, but does not apply to pEAKff. 

Another, rather specialized, split-e*Eending heuristic applies 
to the five-line HULTl With two Col linear Hnea, illustrated iu 
figure 2-22. Figure 2-23 shows an example of this configuration in 
a ccene. 

If either of the links generated by one of the above heuristics 
Is inhibited by the link-inhibitor described below in the discussion 
of phase 3, then the split is not extended. The other link is still 
ple.ccd if opt inhibited. 

Finally, another specialized heuristic is depicted in figure 

„r 

2-F4A. Although FQftt b and ARK?W d have both linked regions I and 2 
in the initial-linking phase, the split entering the FORK along a-b 
provides strong enough evidence to break both the links by extending 
the split along b-d. Of cqutsc, the Bynacc Er i c a 1 split along b-c 
would also have been sufficient evidence. A split is similarly 
extended from the FOk& to a PEAK as in figure 2-24B. Applied to the 
aitbigucKis scene shown in figure 2-2JA, this heuristic enables SElttSpftK 
tp produce the analysis repreaented in figure 2-251!. 
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Figure 2-24 



Figure 2-25 
















The aplit-cutending routine iterates until no further extending 
can be done* If any strongly-linked nuclei f.fe formed during Split 
extension or at any subsequent point in phase 2, the routines which 
were employed flfc the beginning of phase 1 (section 2.1.2.1) art 
invoked to verify objects and make splits accordingly. 

1 . 2.2 Apply weaker splitting heurt e ttca 

After the initial splits of phase 1 have teen extended* there 
often remain Split* which are incomplete or split E ing-vertices through 
which no splits have yet traversed. If this is the case, SEEtlQfcE 
employs weaker and more conditional evidence to propose and extend 
additional splits* As will be seen later* SE£MDR£ stands ready to 
generate alternative analyses, if requested by a higher - level program, 
by backing up and placing alternative splits. 

The remainder of this section catalogues several configurations 
which seem to provide weaker evidence fot Splitting in many scenes. 
5EEM0KE attempts to apply these heuristics in the order in which they 
are presented below. The first applicable rule is invoked In each 
iteration until the list fs exhausted' splitting is then complete, 

2.2.2*1 Heuristic? split along the pert-adjacenfc lines 

Thfs is a generalisation of the split-extending rule for four- 
line vertices. Given the generalised four-line vertex of figure 2-26, 
this rule indicates the alternatives of splitting along either a-b-e 
or d-'b-e. SEEJEHEE tsfces these alternatives into consideration when 
applying any of the heuristics below to a four-line vertex. 
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Figure 2-H 
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2.2*2*2 HeuriSt ici make the most Complete Split possible 

The above tide is actually a general statement of two specific 
rules which are applied at each four-line vertex which is not t FEA.K., 
has not yet received any splitsj And does not border on the background . 
Onf of these rules is: extend an unfinished split to the background or 
to another unfinished split whenever ppsstble. For this purpose, an 
unfinished split is defined aa one which terminates at a vertex not 
bordering on the background. Additionally, if A Split traverses a 
MULTI but leaves these or crate adjacent lines unsplit as shown in 
figure 2-27* an unfinished split is considered to exist at the MULTI. 
Look at figure 2-28. Notice that an initial split is made along 6-d. 
then extended along d-C. The present rule favors Splitting c-s-b 
tather than g-A-f, in order to complete the unfinished split ending at 
vertex c. 

The other specific rule, to be tried if the first does not appLy, 
iar split to the background whenever possible. In figure 2-29, for 
example* we consider Splitting either b-S-c or e-a-d. The present rule 
would prefer the former split, since- J> and c both border on the back¬ 
ground, while t_ is an internal vertex. 

In the example of figure 2-30. the spl1t-to-background rule 
indicates splits c-s-d and c-b-d. The resulting analysis proposes 
objects (1 2) a (3 4), and (5 d), which could plausibly represent three 
tetrahedra. Huoans seem to prefer the analysis (1 3 5) and (2 46), 
Switch Is produced -as An alternative by SEEMORE, Perhaps thd appro¬ 
priate heuristic here involves minimizing the length of splits used or 
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the numbet of bodies found} neither of these factors ts taken into 
account by SEES-lOtLE. 

One further example indicates the power of the 1 most-coraplete-split 
heuristic. In figure 2-31, SEEMDRE uses this heuristic to correctly 
Split along C-d-a, producing the plausible bodies {1 2 3 ), (4 $)* and 
(5 7). The inherent complexity of thfe scene is reflected in SEE *j 
answer; bodies Cl 2 3>i (4 5 7)* and ($) are repotted, 

2 + 2,2,3 Heuristic: split between a p-3ir of splitting-vertices 

This rule applies only to pairs of spl it ting- vert ices which- ate 
neighbors on the same line (figure 2-32) of which have a common 
neighbor (figure 2-33), Each of the vertices a and b in the figures 
mu si be either a PEAK, a ttUI,TI of wore than four lines* or a four-line 
vertex which he* Chusfar received no splits. Fur thermo re* a and b 
inuSf be neighboring only each other £n this fashion* 

If these condi tiofts sre met* Splits are placed as shown in 
figures 2-32 and 2-33, Hie #pli£-extendCr is used if applicable. 

Both .forms of this heuristic may simultaneously apply in some 
tflS«: 3 , An example is figure 2-34 , which contains two neighboring 
PEAKa. The first analysis splits between the PEAKS directly* along 
a-b. This will generate EEEMORE 1 s Initial guess: bodies (1 2 3) $nd 
(4) are reported (figure 2-35). If an alternative is requested* the 
alternative split to a Common neighbor of the pair of splitting- 
vertices £s used. In this case, the only common neighbor vertex is c* 
and the * 11eirnjiri v e split ip a-c-b, The resulting alternative answer 
reports bodies (I), (2). and (3 4)* as shewn in figure 2-3$, Both 
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Figure 2-33 
















Figure 2 -35 
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these alternativCa arc plausible analyses of the scene,. 

2*3 phase 3: link a*nj Conglomerate 

When phase 2 of SEYMORE- cannot- start any new Splits or extend any 
Cxi sting ones, phase 3 is entered. Phase 3 applies the resnaimi.ng 
heuristic b of SEE, with a few madif Icat jLone as outlined below. In 
this phase the remaining links ape plated a subject to the constraints 
of Splits already made, 'Nuclei art formed and single-region bodies 
are handled in similar fashion to SEE. Phase 3 generates a tentative 
analysis, which is presented to a higher-level program for approval, 
2.3.1 Completion of linking 

The Initial linking has already placed links at FORks, ARROW s, Emd 
X-joints as shown in figure 2-37. Some of these will have been 
inhibited by the phase I link-inhibitor. Others will have sub¬ 
sequently been broken by splits. Kcw Links may have bean added by the 
phase 2 routines. The linking is now completed by placing strong and 
weak links exactly a3 SEE does, except IS Specified in the paragraphs 
below. Refer to Gusraan^S Th.D. thesis [4], pages 01 through BB a for 
detailed descriptions of the Linking heuristics. 

2.3.1*1 Inhibition of links 

Figures 2-38 and 2-39 illustrate the situations in which links 
are inhibited doting the final Linking Stage of SEEMORE. Figure 2-3S 
depicts inhibited Links which are also inhibited by SHE. These 
include links across lines with passing-Ts; notice, however, that 
ARROW links art not inhibited by the passing -T. A Leo inhibited are 




Figure 2-3? 'initial Lints 
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links between any object and background; and links cctoss the outside 
line of a PEAK or an ARROW. Notice that the thro ugh-Ts function has 
been restricted a? shown in figure £-.39* In the matching-T situation 
parked In the figure by a broad arrow* the sa m e region K. must border 
the tenter lints of both of the T-joint a, R in this cast mJy not be 
background. 

Links are also inhibited across split lines (figure 2-40) + Also 
shown in figure 2-40 is the pair of neighboring FOkKa * across which 
strong links are inhibited and a single, weak link is placed as shown. 

A linking heuristic used in Guzman 1 a program is illustrated in. 
figure 2-41A. It is GBitted from 5EEH0RE because it is inconel start 
with the assumption 1 have made that the type of each vertex is in* 
variant under small perturbations of the viewing angle,. Another 
heuristic used by SEE, illustrated in figure 2-4LB. is made unnecee 
eary by other heuristics of KEUtOftE, 

Unlike SEE, 5EEMJUKE does not place matching-I links at this step. 

These are treated separately, as discussed below. 

2.3.1.2 Formation of nuclei 

On the basis of strong and weak links which have been placed up 
to this point, SEEMOEE conglomerates nuclei using the heuristics of 
Guzman 1 s program. After conglomeration is complete, matching-! links 
are processed as described in the next section, 

2.3.1.3 Matching-Ts 

SEE^JOkE * s decision to link cr not to link across a pair of 
matchlng-Ts is always made provisionally. If the higher-level program 
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registers an appropriate complaint* SEEftQJiE stand e ready to change its 
mind about the matchlng-T links involved, 

Figure 2-42 illustrates two possible matching-T Configurati.ona. 

In figurt 2-42A, the same region ft borders on Che center tines of both 
Ts, In this'case, SEEMQRE will piece a link between regions 1 and 2. 
This heuristic still applies if ft is background* ftotlce that if 
regions 1 and 2 were also identical, there would be no need to plate 
any links at all. The link between regions i and 2 will not be placed 
if there is a split between any member of the nucleus to which region 
1 belongs and any .member of the nucleus to which region 2 belongs. 

In figure 2-42E, regions 1, 2, 3, and 4 are all distinct* In 
this ease SEKMQftE does not place links on the first pass, but planjf 
to link 1 to 2 and 3 to 4 as an alternative. As before, matching-I 
links between two different nuclei arc inhibited if a Split exists 
between members of those nuclei* 

Figure 2-43 illustrates some typical applications* When presen¬ 
ted with the scent of figure 2-43A, SEEftDRE generates s split and 
I£e1:e as shown. The split inhibits all of the possible matchtflg-T 
links; SEQdOftE finds bodies (467), (12 3), and (S £)* In figure 
2-43B there are no Splits* Using the matching-T heuristic, SEEMDHE 
places a single strong link between region* 4 and 5, and another 
single link between regions 7 and S, These arc sufficient to con¬ 
glomerate body £4 5 $ 7 S)* If the higher-level program indicates 
that (4 5 6 7 B) must be split apart, EEEMDRJi Will back up at*d remove 
one or both of the offending links, depending on the eicact form of the 
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coEplaint. The result will be two separate bodies, {4 6 7) and (5 * 

The scene of figure 5-43C WUW present problems fot SEE due to 
the large number of spurious matchihg-T links. Using the modified 
matthlng-T heuristic* SEEMORJE does not plate any of the spurious links;, 
all of th# separate bricks are -correctly identified. 
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3 Producing alternative answers 
3, 1 The natuTf pf a complaint 

If a higher-Level procedure is dissatisfied with SEYMORE* s first 
attempts it should ideally return to SEEMQRE with the following ini or- 
mat Lon; 


1) a li Et of the regions which have not been satisfactorily 
Conglomerated 

2 ) the nature of the complaint: body has too many regions/ 
is overlinked; body has too few regions/ is underlinked; 
body (ox bodt-Ss) unrecognizable / does not make sense; 
analysis of the scene is plausible* but alternative(s) 
desired► Specific regions should be related to each 
Complaint, 


Of coursej it may not always be possible for a higher-level 
program to provide a complaint in such detail, It is conceivable that 
a number of objects, or even the whole scene might be incomprehensible 
to the higher procedure. If there are not many splitting vertices in 
the stlne, the number of alternatives which SEEMDHE can generate is 
small and could be exhaustively enumerated if necessary. Usually, 
among these alternatives would be the original SEE’s analysis of the 
scene. 

3.2 the alternative-list 

Each time A splitting heuristic i* employed in phase 1 or phase 2 
of SEEJC1)SE» a notation la mads at the top of a special list called the 
alternatjve-Hst ■ Each entry in the alternative-liEt identifies the 
regions for which the given heuristic has made a splitting decision* 
called reference-regions, and indicates what step(s) should be taken 
to generate an alternative tpLitting analysis for the specified 




-regions. The a It etna t ive-list entry also indicates what sort of 
change can be expected if the given alternative is employedj 
spec if leal ly „ the entry may indicate more-splitting* less-splitting, 
or dAfferent-splitting, A mote-split ting alternative is expected to 
split apart two or more currently-conglomerated regions; a less- 
splitting Alternative is likely to conglomerate currently separated 
regions; while a different-splitting Alternative will help to gener¬ 
ate an alternative partitioning of the indicated regions. The 
splitting and linking which is indicated on the alternative-1 let fa 
described, bu.t not actually carried out unless 0 Complaint ia being 
acted upon.. 

Entice that the alternative-list is ordered according to a 
heuristic measure of Strength* with alternatives produced by less 
reliable rules appearing nearer to- the top of the list, later, when 
processing a complaint, EEEM0KE will try these alternatives in. order 
Starting from the top of the Hat* since the alternatives appearing 
there were produced by heuristics more likely to make mistakes, 

3.2.! Producing alternative-list entries -- phase I 

There is only one alternative to applying a given splitting 
hem 1stie in phase Is not applying it. This will be entered at the 
top of the aiteroefcive-llst as a leas-splitting alternative, along 
with the regions between which the given split passes. 

3*2,2 Producing alternative-list entries -- phase 2 

Let TJS first consider splits which are extended by one of the 
split-extending heuristics. In ail such cases* the alternative is 
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ftot to extend Che Split, This is entered on the alternaC4 ve-list ai 
a less-splitting alternative, with the bordering regions of the 
ejtte^aion split as reference-regions, 

For any split generated in phase 2 by the most-complete-split 
heuristic* two entries are made in the alternative-list. The first of 
these, a less-splitting alternative, inhibits the split entirely. The 
Other entry* representing a different-splitting alternative, indicates 
both emitting the original split* and plating an alternative split 
along the pair o£ lines originally unsplit. 

yiguxe 3-1 illustrates the rule Just stated for a four-line 
vertex- In figure 3-1A* the mast-Complete-ipUC heuristic has been 
applied to vertex a to produce the Splits and links shown. At the 
sair.i time, two alternatives are indicated on the alternative-1 iat. 

Th e less-splitting alternative* with no splits or links, Is shown in 
figure 3-lE. The different-splitting alternative is depicted in 
figure 3-lC. Here the original split has been abandoned, while 
alternative Split c-a-b is made and links are produced as shown. 

If the split-between pairS-of-eplittfog-yertice* heuristic is 
app]ted* one Indicated alternative 1$ to Split to a common neighbor 
vertex, «s illustrated in figure- 3-2. This is a different-aplit ting 
alternative. Additionally* the alternative of no split at all is 
indicated as a Less-splftLing alternative* 

Throughout phases 1 and 2* whenever a 3plit is inhibited, a more- 
splitting alternative is recorded which makes the inhibited split. 
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Figure 3-2 
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3,3 The processing of a complaint 

When a complaint is issued fey fl higher-level program* 5-EEMQRE 
experts to be provided, AS mentioned earlier, with a list of regions, 
and the nature of the complaint associated with the given regions. 
Starting at the top of the alternative- list * SEEHOJtE examines each 
entry in the list until It finds one whose referante-region* match 
well with the list of troublesome regions, and which li of a type which 
would tend to correct the complaint. Fot example* if the complaint 
says that a body has too many regions* .SEEM'fiE will look for rare- 
splitting entries with reference-regions from the given body. If An 
appropriate entry is found, SEEMORE takes the steps indicated in the 
entry. Then the phase 3 routines are used to complete the linking and 
see if £o alternative analysis has actually been gene-r * ted. If there 
Are no more-gplit_ting entries in the alternative-list with appro¬ 
priate reftrtnce-vCrtices, or if no alternative is actually produced 
' by the entries considlcred, then SEEtaQEE makes one laEt effort by 
searching for different-splitting aIter natives with the proper 
reference-vertices, If no alternatives are ultimately produced, 

SEEHQRE- would have to report its failure to generate an Alternative 
Analysis. If an alternative is produced, it is submitted to the 
higher-level program. £ot approval. Additional Alternatives could be 
produced in the Same manner if necessary. 

If the complaint had been that a body was composed of too few 
regions, the above steps would be fo-Llowed r except that lees- spl Itt log 
Alternatives would be sought instead of more-splitting ones, 
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If the higher-level program fourth the original analysis plauaiblc, 
but desired On alternative if possible, then jjf Ferent-spl itt jng, 
alternatives would be sought first * followed by more-splittin& and 
less-splitting alternatives if necessary. 

Finally* if the higher-level program complained that it could 
make no sense of SEEMQkE 1 s analysis* any type of alternative would be 
considered. In this c**e, it is of great help to SEEMORE if the 
higher-level program specifies region* which it suspects of causing 
difficulty< 

EEEMOEE 1 S alternative-generating procedure ia successful in 
producing the alternative* shown, for the simple ambiguous scene of 
figure 3-3* and the more complicated scene of figure 3-4. 
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4 Some examples 

4.1 A detailed example 

I can new explain in detail Che operations performed by SEE^OEK 
in analysing the example presented earlier, which is reproduced in 
figure 4-1, 

Links made by the initial linking routine are depicted, in figure 
4-2A. Nuclei (2 3) and (9 10) ate proposed as unoccluded bodies which, 
presumably, are rejected by the h igh St -1 eve L procedure. Figure 4-2B 
shows the link diagram, at this point. As shown in figure 4-3, the 
initial splitting routine initiates Splits along a-f, b-C, and j-e + 

This Completes the initial splitting and linking phase (phase 1). 

In the additiofial-SpliCa phase (phase Z), further splitting 
Operations are performed. First, the split along b-c is extended to 
vertex h, which also links regions (5 6) and (9 at vertex c. 
Similarly, Split a-f is extended to jj, and split J-C is extended along 
r-g. Then split h-d-fc if generated at splitting-vert** d by tha most- 
complete-split heuristic. The Split h-d-k also produces the links 
(7 11) and (S 10) at vertex d, Additional-splits phase 2 has now 
been completed, as illustrated in figure 4-4. 

Finally, phase 3 is invoked- The remaining strong and weak links 
are placed, as illustrated in figure 4-5. The corresponding link 
diagram £a Shown in figure 4-6. Next, procedures Similar to the rou¬ 
tines of SEE are used to conglomerate regions on the basis of the 
strong and weak links which have been placed. The final nuclei are 
shown in figure 4-7. SEUlOElE report* the four bodies (2 3 4), f5 4), 
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Figure 4-4 
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Figure 4-5 
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Figure 4-6 
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(fl 5 10)* and (1 7 11). 

4,7 Other examples 

Figures 4'? through 4-17 present several additional examples In 
abbreviated form. For each example the scene is presented with all 
splits and links indicated* and the bod lee found by SEEttORE are listed* 
In the examples of figures 4^9 and 4-12* an alternstrve analysis 
generated by SEEMORE Is also shown. 
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5 Failure* □! 5EEH0RE and recommendations 

SEEMORE often relies heavily for -success upon the technique of 
Cong Lome rat Ing and recognizing unots cured objects early in its 
analysis* F^r example, in figure 5-1, SEEMORE correctly splits along 
e^*-b^e by £ir*t verifying object (1 £) + Since the corresponding 
object in figure 5-2 1 b not fully visible, splits C**-d And e-b-d will 
be generated* Consequently, SEICHE reports objects (1 2 3), {46), 
and (7 5 8 9)* Notice that figure 5-2 is a difficulty scene for 
hum.-: rL-'i , too. 

Although SREMORJv doe* provide for interaction with a higher- 
level routine, perhaps this interaction has not been carried far 
enough. For example, an extended version of EEEMORE night be avari: 
of the kind of body It was looking for, say a rectilinear brick. If 
night recognize a FORK as the possible corner of a brick, then extend 
the lines of the PqFsA looking for the other corners. Or perhaps, 
having recognized an object in the scene, it would be able to 
hypothesize what the scene would look like if that object were 
removed* It could then proceed to analyze the stapler scene* pro¬ 
cedures with such capabilities could only result from a major over¬ 
haul of the pretext vision System. 

Another kind of problem result* ftom certain scenes in which 
crucial splitting evidence i* obscured. An example of sutb a scene is 
figure 5-5. khat ii needed here is a line-extender, whose use might 
be indicated by the T- joint e et a, b, and d. 
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